Compositionality for Markov Reward Chains with Fast Transitions
نویسندگان
چکیده
A parallel composition is defined for Markov reward chains with fast transitions and for discontinuous Markov reward chains. In this setting, compositionality with respect to the relevant aggregation preorders is established. For Markov reward chains with fast transitions the preorders are τ -lumping and τ -reduction. Discontinuous Markov reward chains are ‘limits’ of Markov reward chains with fast transitions, and have related notions of lumping and reduction. In total, four compositionality results are shown. In addition, the two parallel operators are related by a continuity property.
منابع مشابه
Compositionality for Markov reward chains with fast and silent transitions
A parallel composition is defined for Markov reward chains with stochastic discontinuity, and with fast and silent transitions. In this setting, compositionality with respect to the relevant aggregation preorders is established. For Markov reward chains with fast transitions the preorders are τ -lumping and τ -reduction. Discontinuous Markov reward chains are ‘limits’ of Markov reward chains wi...
متن کاملAggregation Methods for Markov Reward Chains with Fast and Silent Transitions
We analyze derivation of Markov reward chains from intermediate performance models that arise from formalisms for compositional performance analysis like stochastic process algebras, (generalized) stochastic Petri nets, etc. The intermediate models are typically extensions of continuous-time Markov reward chains with instantaneous labeled transitions. We give stochastic meaning to the intermedi...
متن کاملAnalysing reward measures of LARES performability models by discontinuous Markov chains
This paper presents a new method for specifying and analysing Markovian performability models. An extension of the LARES modelling language is considered which offers both delayed and immediate transitions, as well as rate and impulse rewards on whose basis different types of reward measures can be defined. The paper describes the evaluation path, starting from the modular and hierarchical LARE...
متن کاملDistributions of Reward Functions on Continuous-time Markov Chains
We develop algorithms for the computation of the distribution of the total reward accrued during [0, t) in a finite continuous-parameter Markov chain. During sojourns, the reward grows linearly at a rate depending on the state visited. At transitions, there can be instantaneous rewards whose values depend on the states involved in the transition. For moderate values of t, the reward distributio...
متن کاملDecompositional Analysis of Kronecker Structured Markov Chains
This contribution proposes a decompositional iterative method for the steadystate analysis of Kronecker structured Markov chains [1]. The Markovian system, which is formed by a composition of subsystems using the Kronecker sum operator for local transitions and the Kronecker product operator for synchronized transitions, is assumed to have irreducible subsystem matrices associated with local tr...
متن کامل